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The present paper questions the validity of Macnamara’s 
(1966) finding that teaching arithmetic through a bilingual's 
weaker lahguage leads to retardation in problem arithmetic. 

By comparing the*performance of immersion pupils on an Irish (L2) 
version of the problem arithmetic test with the performance 
of non-immersion pupils on an English (LI) version, 

Macnamara’s study confounds bilinguals' competence'in 
.arithmetic with, their ability to demonstrate this competence 
when‘tested through their weaker language. Macnamara’s 
attempt to demonstrate the equivalence of Irish and English 
versions of the problem arithmetic test fails to take 
account of probable differences in : Irish competence between 
the immersion pupils in the pretest and tho^e in the main 
study. ” 
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Immersion Education in Ireland; 
Critical Review of Macnamara's Findings 


James CumnfiPhs 

Centre for the Study of 'Mental Retardation 
The University of Alberta 


'• In "Bilingualism and Primary Education" John Macnamara 
(1966)' reported two principle findings regarding the 
educational effects of the program for the restoration of 
Irish. Firstly, he found that th.e teaching of arithmetic 
through Irish to native English-speakers resulted in lower 
levels*of problem but-not'mechanical arithmetic. Macnamara 
argues from this result that the use of x 'a_Jbilingual' s 
weaker language as a medium of instruction involves 
retardation in the subject matter taught. Macnamara's 
second finding was that the English'attainment of Irish 
children was very much below that of English children. 

This second finding Ls attributed' by Macnamara to the . , ~ 

.different amounts ^f time spent teaching English in Irish 
and English schoola conclusion which seems reasonable, 
although as Macnamara admits 1 , other factors may alsb be 
operating/ 

* # 

Macnamara's study has been influential in promoting y 
a "negative theory of bilingualism" (Stem, 1973)» although 
recent North American bilingual ♦education^experiments have 
not supported hi's. findings. The present paper questions 
the validity of Macnamara's first finding on the .grounds 
that his study confounds bilinguals' competence in arithmetic 
with their ability to demonstrate this competence when 
tested through their weaker language. 

The starting point for this criticism comes from 
comments made.by Lambert and Tucker (1972) in their 
introduction to the St. Lambert bilingual education experiment 
in Montreal. Discussing Macnamara's findings, they note-- 
that children from English-speaking homes who take all 
their schooling through Irish (Macnamara's group 5 * P* 48 ff. 
and p. 101 ff .9 do as well or better in English', Irish and 
mechanical arithmetic as children taught exclusively in 
the^home language (be it Irish or English). '■ Lambert and 
Tucker attribute the fact that this group performed at a 
significantly lower level than the other English-background 
children on a test of problem arithmetic 

„ "...to the fact that, because of school requirements 

group 5 had an Irish translation of..the Problem . 
Arithmetic test rather than the English version given 
groups 1-4. Since group 5 scored highest in the English 
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tests, they very likely would have done as well or 
better on the Eriglish version especially because 
concepts of buying, selling, dividing, etc. would 
all be more vivid in their home language." (1972, p. 7) 

V 

k 

A closer examination of Macnamara’s data adds weight 
to Lambert and Tucker's point. Retardation in arithmetic 
among group 5 (immersion} children is observed only in 
problem arithmetic despite the fact that both problem and ■ 
mechanical arithmetic have bedn taught through the children's 
weaker language. The difference between problem and 
mechanical arithmetic tests lies in the fact that in 
problem arithmetic the test items are expressed in n sentences 
whereas in mechanical arithmetic items are expressed in 
arithmetical symbols. XThus, a pupil's grasp of the language 
of testing is likely to play a much larger.role in problem 
than in mechanical arithmetic.. . \* 


v 

How is an inadequate grasp of the language of testing 
likely to^alfect a child's performance on the problem 
arithmetic lest in which "he is required to rlad and 
interpret proSe passages " (Macnamara, 1967 , \p. '*122) • The 
answer to this\mdstion comes from a series of studies 
carried out by Macnamaraliimself__(Kellaghan and Mnnamara, 

1967_; Macnamara-, 1967)- Briefly, the findings of these -. 

studies were that « \ 


* > 0 
a. "...bilinguals take longer to solve written 
problems when-they are presented in their 
weak rather than .their strong language'' 
(Macnamara, 1967 y/p. 1237* 


b. 


"...the problem-solving ability of bilingual 
children i-ej poorer when the, in forma tiqri is. provided 
in their weaker language, even when the components 
of the problem, are separately understood" 
(Macnamara, 1967, p. 125)*. / 


c. 


reading of arithmetical problems in Irish* ; 
took from 1.4 to 1.7 times as lohg as reading 
the same, problems in English berth for native 
English-speaking children who had been taught all 
subjects through Irish and for' children who had 
been taught all subjects in English.' ' 


Macnamara (19&?) concludes that (when problems ar&/ 
presented in a bilingual child's weaker language he has 
"greater .difficulty in making but toe meaning... Consequently 
he has greater difficulty, in pieking Tout, what is relevant 
to his purpose and discarding the/remainder (p. - 131 ')'". 


Macnamara ( 19 66, p. 137, footnote 2) seems to interpret 
the results of these experiments as support for his position 
that children taught through a Weaker language are likely 
to suffer subject-matter retardation as a result. However, 
the findings equally suggest/that children tested in their 
weaker.language will peTfo^yless wteli rthan if tested in their 






stronger -language. Thus ,^Macfiamara' s (196?) own findings 
suggest^ that group 5 children may have been at a definite, 
disadvantage in having ’to take the probldm arithmetic' test 
. in their weaker language while children in the other 
English-background groups -took the problem arithmetic test 
in their stronger language. This probability is increased 
when one considers, that when I.Q., social class and quality 
of teaching were controlled, Macnamara found "no significant 
differences in Irish or in English between children who , 
had been taught throughout their six years of primary 
schooling in Irish, and those taught in English" (196?, p. 133") 
In. other words,’ as far as reading skills were concerned, 

Irish was just as much a weaker language for group 5 
children as i't.was for the other English background groups. 

* i 

Macnamara was aware of the dangers involved in 
giving different versions of the problem arithmetic test to 
different'-groups and attempted to show that the Irish and 
English versions- of ^he test were equivalent in. difficulty 
for group 5_ children-. The problem arithmetic test was 
.pretested with 96.children in six different schools.' Two 
of the. schools were in Co. Donegal and four in Dublin. 

One of. the Donegal schools was in a bilingual•area and almost 
half its pupils were native Irish-speakers. Pupils in the 
schools were 'divided at random into numerically equal 
“groups anU--wer-e--teated—with_pither Irish or English versions 
of the test. Pupils who took the Irish version scored about 
two points lower than those, who took the English version # 
(Irish mean 92.8j English mean* 94.8). Macnamara followed 
up this experiment by retesting the Dublin children in a - 
different language and calculating difference scores between 
'first and second administrations./)! the test. Children ' 
who took the English- version after the Irish version gained 
an average of 8#1 quotient points whereas children who took 
the Irish vepsion after the English version gained only 1.6 
quotient points (figures calculated from Macnamara, 1966, 
p. 64, boys and girls combined),. These figures suggest 
that the Irisft version may have been somewhat more difficult. 
However, when scores were analyzed- separately for boys and 
girls the differences/were non-significant, although fbr 
boys the differences approached significance (Table ?.6, 

P* 65 ). • 

The important point in relation to *the pre-testing of 
the problem arithmetic te§t is.not that the^ Irish version / 
proved consistently more difficult than the''English version, ' 
although Macnahiara ( 1966 -, p. 79 ) states that.a similar trend 
for the Irish version of the nonverbal reasoning test * / .: 

caused "some misgiving". The important point is rather that 
the six immersion schools in which the problem arithmetib 
testwas pretested were not in any way representative of/ 
the immersion/schools in Macnamara*s group 5. / 
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The atypical nature of these schools is immediately 

.obVious when one compares their performance on-the problem 

■ arithmetic test' with the performance 1 ' of the gr.ovips in 

Macnamara's main study. The problem arithmetic mean for the 

pretest sample is 94.8 on the English version and 92.8 

on the, Irish version - almost ten points higher (oq the Irish 

version) than- the group 5 mean .and 6-5 points higher- (on 

the English yersion) than any of the other groups in the 

main study! i , 

» 

An examination of- the characteristics of the pretest x 
schools-provides additional evidence that these schools 
are very atypical of the group 5 schools which., participated 
-in Macnamara’s main'study. \Four of the six pretest * 
schools-were in Dublin whereas all but four of the total of 
119 schools in the .main study were from rural areas and- 
\ country towns (pi 74). The exact number of urgan group 5 
schools used in''the main study is not given, but it can 
hardly have been- more than one. . The importance of 'this 
lies in the fact that < 

* / * 

"...in/rural areas and country towns...few parents 
had a/choice of schools for their children... Thus, 
it is quite unlikely- that the parents of children 
who/attended most Irish medium schools in English- 
speaking areas differed in their attitudes towards 
Irish or English from the generality of Irish parents..." 
(1966 ,,pi 74). 

* * 

In other words, many of the parents of children in Macnamara‘s 
group 5 schools would’ have held neutral or negative 
attitudes towards Irish and fewer than 10$ would have 
spoken any Irish at home., however, in ur.ban'areas' 
parents ao have a wide choice of schools and those who 
£end their children’tollri^h Medium schools tend to be 
/middle class, have very.positive attitudes towards Irish^. 

/( and frequently 'speak Irish at home. Consequently, 

/ because of higner SES,.greater use of Irish at home and 
motfe positive parerital attitudes towards. Irish, the- 
Dt&lin cfhildren in the pre-testing of the problem Arithmetic 
^st are likely to have had a. mucfy higher level of Irish '• 
.Competence than the majority of groups 5 children‘in the 
^/main study. - These differences between pretest and group 5 
/children are reflected in the marked/ superiority "of the 
pretest children on ‘the problem arithmetic, test. 

The point is that even if the Irish and English-versions 
of the problem arithmetic test were equivalent for the pretest 
sample, the -atypical nature-of, this sample rules* out the 
possibility of gene, alizing this equivalence to the group 5 
- children in the main'.study. .In short,, the equivalence* t>r 
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n 9E-' e 9^- va -*- ence the Irish and'English versions is a' 
function not only of the tests themselves hut also of 
•the Irish and English competence of pupils.taking the 
test. Because MacnamaVa fails to demonstrate "that the 
pretest and group 5 samples hhd similar levels of Irish ' " 
competence* and because there i&'reason to believe that ‘\_ 
they had/not, his attempt tq demonstrate the equivalence 
of the Irish and .English versions of 'the problem arithmetic . 
te'st is unconvincing.' o * •; • / 

’ i • 

*" -# V . ^ „ * 

<• If the Irish and Palish versions of the problem ' , 
arithmetic test werq. not -Equivalent for group 5 children 
then Macpamara’s findings mdy amount to nothing more than 
that children tested through their weaker language.perform 
more poorly than children Rested through their stronger 
language/ . 

In opposition to this ft might be* argued that if a 
child's Irish competence is so*low tha*E he is handicapped 
on an Irish version of- the*problem arithmetic test, then 
he is unlikely.to optimally benefit from instruction 
through* Irish. It is unfortunate that Macnamara• s,data 
do not permit us to test this hypothesis empirically.. 

In respect -to the problem"arithmetic data, the effects 
of receiving instruction through a weaker language are , 
totally confounded with the effects of performing a test iij 
a weaker language. Thus, no* inferences regarding the 
effects of receiving .instruction through a weaker language 
can be drawn from Macr\amara's study. 


However, the fact that the Irish reading competence, ... 
of■group 5 children was no higher than that of. non-immersion 
pupils suggests that one of the objectives of the immersion 
schools was not being attained: This is not -surprising 
given.the fact that parental spppqrt for-the immersion 
program was probably, at best, lukewarm. Thus, it is 
quite possible that some children in these schools who * 
TremalrBd'''v^Ty''mrucir- m ore* ••do min ' an 1 t~ “in S gj glls h-ma y -n-ot have-;— 
benefited optimally from ins true tion^thr&iigh Irish. This— 
possibility suggests the .potential fmibfulness of regarding 
the L2 competence attained by. pupils riTlmmersion programs 
as dn intervening variable in .evaluating the academic and 
cognitive ef fects...of the program (see Cummins, 1976, ‘1977). 


7 
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^Footnote 


A survey of teachers 'in all-Irish schools (carried 
out by the writer in 1976) showed that over 60 % of. 
pupils in Dublin immersion schools spoke Irish at 
least some of-• the' time 1 at home. 
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REPLY TO DR. CUMMINS 


'JOHN MACNAMARA 


McGill University 


Dr. Cummins argues tVat I misinterpreted the findings of my own study" 

. N * • 

* j ■. I ’ 

(Macnamara 1966) relating to^rithmetica) problems." The children in question 
* » 

1 ^ s ♦ 

were, native speakers of English wbo had been taught all subjects, including* 

• • , ♦ 3 
arithmetic, through the medium^pf Irish. Their problem arithmetic’ test 
* , » 

* - * r ' 

was in’-Irish. Cummins believes that they would have scored significantly » 

• • * A 

■ . . . . . - * 

better if (hey had been tested wjith the English version of the test. This * 

• 1 * “ 

• • • *«• o 

Xf ■* * 

despite the .fact that in pretest "comparisons of the Irish and English versions 

♦ \ 

there was no evidence tq this effect’.; and he has none'either. He claims that * 

v , - • 1 

"A 1 • > -4 • 

y « , . * 

the schools used in trhe pretests* were unsuitable because the*children there, 
were especially good at Irish, their second language. " 

* , * . a 

This is" meant to buttress the case that the run of Irish children who^ 

•speak only English at home .and in the environment would Ifare as well if taught 
» * 
problem arithmetic in Irish as if they were taught in. English'. His case rests 

x " ' ' V ' - * ■» . .. 

* • . 

on the’fact that they are weak in Irish. He even, underlines their weaknetss by 


citing other studies carried out'by Dr. Tom Kella'ghan and myself which showed' 

’ . v v 

that iri^sh-’taught English speakers (a) read Iris'b more slowly than‘English'.(b) 

that they have greater difficulty coping-ja^ith information presented in Irish,. 

* • 

« « ' •. » ' ... 

(c) they are l,ass successful in solving problems presented in Irish. V 

> V 

There simply is no dealing with such stalwart -ljogic. However his final 

• • « ;r * ; • 

." ■ • • 

paragraph has the redeeming merit of’seeming to Retract his whol^ case. 


m/ifm 



.129. 


Renly to the Reply , 
James Cummins 
The Universitv Alberta 


Significantly, Dr. Macnamara's reply ignores the issues I^raised in 
relation to the design of His st.udy. Briefly, the criticism was that the 
.pretest equivalance of the Irish ^nd English versions of the-problem 
f arithmetic' (PA) test, cannot be generalised to the 1 immersion^group j^J.n the 
(nain stiidy because of patent differences between, tKe-pretest sample^ ^gmd . 
the sample in'the ,'main study. Consequently, the effects of“testing through 
a wea'k'ei language are totally cc^fwinded'with the effects.of instruction in 
'■ a weaken language. , • | „ ; , ' r 


aag y 


; .. • f 

v Does Macnamard' dispute the validity of this criticism or does he* 
acknowledge its validity?. I don f t‘knov. Although he doeS raentioii^he • 
claim that- the schools used in the pretest we^e '^unsuitable" he' does not 
pursue th|e issue. In tHeyabsenoe of any attempt to refute this "claim" 
one* must presume that Macnamara acknowledges “its validity. 

! " / ' ' * ^ 


. ■ . - . * 

What about my alleged "case" to which Macnamara devotes his energies? 

Macnamara s interpretation of my "case" misses the-point? completely.' ’ *^ ) 

.•Nowhere in the paper did 1 argue that the immersion group would-tfe'ceesaril^ 

— have pertforraed better on ^n English'version lof the K& test.' 1 ’ Such‘an^ f 
argument would clearly pe inadmissible Since th£- effects of testing-, through- 
a weaker anguage are confounded with the effect#, of instruction in.a 
Weaker language. In other words., the lower PA.;SCores of ’the' immersion group 
could be due to either or-both of these^phenomena, but cati/be attributed * 

■ unequivocably to neither. . , t ' « 


Macnamara's study claims to’show that, the lower PA.scores.of jthe' 
immersion group 'are attributable solely to instruction in a weaker lang- ^ 
• uage. My ^claim'is not'that these sccrres arte'attributable solely to the' 
6ffe<fts*of‘ testing in .a weaker .language but that .the flaws 'Jn Macnamara's 
research design? do not allow him, to rule out^this possibility. 


On several occasions Macnamara has rightly warned 'aboj^t th^ gangers 
of generalizing research findings from orte immersion *qoritext”tQ ‘another. - 
His study of Immersion education In, Ireland illustrates these dangers. 

. ■ V "—» . * .... .. • . 
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